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Figure 1: Correlation matrix of ultrametric memory patterns. The number of memory 
patterns belonging to the same group is s = 3, the correlation coefficient between the 
memory patterns belonging to the same group is a, and the correlation coefficient between 
the memory patterns belonging to different groups is 0. 
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Figure 6: Threshold value h c for various values of correlation coefficient a when / = 
0.01, s = 3. The mixed state, which becomes the equilibrium state of the model, can be 
changed by adjusting the threshold value. 
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Abstract 

When mixed states are composed of s memory patterns, s types of mixed 
states, which can become equilibrium states of the model, can be generated. 
We previously reported that storage capacities for most mixed states com- 
posed of uncorrelated memory patterns do not diverge at the sparse limit of 
the firing rate, /—►(). On the contrary to the uncorrelated case, we show 
that the storage capacities for all mixed states composed of correlated memory 
patterns diverge as l/|/log/| even when the correlation of memory patterns 
is infinitestimal small. We also show that, when the firing rate is fixed, as 
the correlation coefficient increases, the storage capacities of the mixed states 
composed of all correlated memory patterns increase, while those of the mixed 
states composed of only some of the correlated memory patterns decrease. 

I. INTRODUCTION 

When an associative memory model stores memory patterns as a result of correlation 
learning, the states generated by the mixing of arbitrary memory patterns as well as the 
stored memory patterns automatically become equilibrium states of the model. These states 
are called mixed states, and they are not simply a side effect that is unnecessary for infor- 
mation processing. For example, Amari's proposed "concept formation model" uses the 
stability of mixed states (Amari 1977). The correlated attractor (Griniasty et al. 1993; 
Amit et al. 1994), which is a model of Miyashita's findings (Miyashita 1988a), is consid- 
ered a mixed state in a broad sense. Moreover, Parga and Rolls and Elliffe et al. used 
mixed states in their research on the mechanism of invariant recognition with a coordinate 
transformation in the visual system (Parga and Rolls 1998; Elliffe et al. 1999). 

In many of the studies on the mixed states of associative memory models, the stored 
memory patterns were not correlated. However, if we use ultrametric memory patterns, 
which have hierarchical correlation, a relationship between the memory items encoded in 
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the memory patterns is naturally implemented by the correlation coefficient between the 
memory patterns. This is one of remarkable advantages for using a distributed representation 
in the associative memory model. Amari proposed an associative memory model that stores 
ultrametric memory patterns (Amari 1977), and Fontanari analyzed the properties of this 
model with respect to the replica theory (Fontanari 1990). Applicability of the replica theory 
is limited, since it cannot be applied to a system in which the free energy cannot be defined 
(e.g., a model with a nonmonotonic output function). Therefore, Toya and Okada focused 
on self-consistent signal-to-noise analysis (SCSNA) (Shiino and Fukai 1992), which can be 
used to analyze the properties of a model in which the free energy cannot be defined. They 
extended conventional SCSNA to generalized SCSNA so that it can be used to treat a model 
that stores ultrametric memory patterns and has a general class of neuron output function 
(Toya et al. 2000). Moreover, they analyzed the mixed states of an associative memory 
model storing ultrametric memory patterns using the generalized SCSNA. 

In the studies mentioned above, the memory patterns with a firing rate of 50% was used. 
However the sparse coding scheme is thought to be used in the brain as indicated by certain 
physiological findings (Miyashita 1988b) and theoretical findings (Tsodyks and Feigel'man 
1988; Buhmann et al. 1989; Amari 1989; Perez- Vicente and Amit 1989; Okada 1996). Thus, 
it is necessary to analyze the properties of the mixed states in a sparsely encoded associative 
memory model. We previously analyzed the mixed states in a sparsely encoded associative 
memory model storing non-ultrametric memory patterns (Kimoto and Okada 2001), and 
found that when s memory patterns are mixed, s types of mixed states can be generated 
and that all of them can be made an equilibrium state by adjusting the threshold value of 
the model. Moreover, among the s types, the OR mixed state generated by OR operation 
on each element of the memory patterns performs best at the sparse limit of the firing rate, 
/ — > 0. This is because at the sparse limit, the storage capacity of the OR mixed state 
diverges as l/|/log/|, and the storage capacities of the other mixed states become 0. 

We have now added a sparse coding scheme to an associative memory model storing the 
ultrametric memory patterns and analyzed the properties of the model using a statistical 
mechanical method. We found that the storage capacities of all mixed states diverge as 
1/1/ log f\ at the sparse limit. 



II. MODEL 

We consider an associative memory model composed of N neurons with output function 
©(•). We use synchronous dynamics: 

N 

x l + l = S(£ Jijx) + h t ), i = 1, 2 • • • , N, (1) 

<*•>={ fhs- < 2 » 

where x\ represents the state of the ith neuron at discrete time t, and denotes the synaptic 
coupling from the j'th neuron to the ith neuron. The threshold value, h f , is assumed to be 
independent of serial number % of a neuron. Its concrete value is described later. The output 
function, ©(•), is assumed to be a step function, as shown in Eq. (2). 
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Memory patterns if are the ultrametric memory patterns with two-step hierarchy (/i 
and u), where fi is the number of group to which the memory pattern belongs, and v is 
the number of memory pattern in that group. Each group includes the s memory patterns 
generated with correlation, while the memory patterns of different groups are generated 
without correlation. Many procedures can be used to generate the set of ultrametric memory 
patterns; we use the following procedure. First, parent pattern 77^, the parent of the memory 
patterns of the group /x, is generated, the parent pattern T7 M is a vector of N dimensions 
composed of the elements and 1, and each component r/f is independently generated using 
firing rate /: 

Probfaf = 1] = 1 - Probfaf = 0] = /, 

i = l,2,-..,iV. (3) 

Next, the memory patterns, rf v (1 < v < s), are generated based on the parent pattern 77^. 
Each component rjf is determined based on ryf with probabilities K and R: 



Prober = 1] = 1 - Prober = 0] = I 



K :rzf = l 
R :r/f = 

l,2,...,JV,i/ = l,2,...,s. (4) 



Many groups are generated with the repetition of this procedure. If the probabilities K and 
R satisfy the equation 

1 - K 

R = f — > (5) 

the firing rate of the memory patterns rf u becomes /. To set the firing rate of the memory 
patterns r\^ u to /, we use Eq. (5). The memory patterns belonging to the same group are 
mutually correlated, since they are generated from the same parent pattern. The memory 
patterns belonging to different groups are mutually uncorrelated, since they are generated 
from different parent patterns. 

We calculate the correlation coefficient between the memory patterns thus generated. 
Since the mean value, E[7jf"], of the memory pattern is /, the correlation coefficient between 
the memory patterns is the term on the left side of Eq. (6). By calculating the correlation 
coefficient at the limit of N — > 00 using Eqs. (3), (4), and (5), the coefficient is equivalent 
to the term on the right side of Eq. (6). 



mr-fM' u '-f)} 



1 : [i — [i , v — v 

a : /i — fx',v 7^ v' (6) 
: n ± n' 

(ff^) 2 (7) 



The correlation matrix of the ultrametric memory patterns is as shown in Fig.l. The corre- 
lation coefficient becomes a in same group and becomes in different groups. According to 
Eq. (7), the memory patterns belonging to the same group are exactly same (a = 1) when 
K = 1, and they become uncorrelation (a = 0) when K — f. 
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The synaptic coupling is determined by the following learning method: 

i aN s 

J -ww)SS ( " r - /)( " r - /) - (8) 

where aN is the number of stored groups and a is the loading rate. 

Next, we explain the "mixed state". We consider the mixed state composed of the s 
memory patterns belonging to the same group. We explain generation method of a mixed 
state by using, as an example, the memory patterns 77 1 ' 1 , 77 1 ' 2 , • • • , rj lyS belonging to the first 
group. The ith element of the mixed state is set to 'V if the number of firing state 'V is k 
or more in the ith elements Tjl' 1 ,^' 2 , ■ ■ ■ ,rjl' s . Otherwise, it is set to '0'. There are thus s 
types of mixed states because 1 < k < s. We call this mixed state -y^^. Among the s types 
of mixed states, mixed state 'y( s > 1 ^> is considered to be an OR mixed state; its ith element is 
given by OR operation on the ith elements of the s memory patterns. Mixed state *y( s ' s '> is 
considered to be an AND mixed state; its ith element is given by AND operation on the ith 
elements. Mixed state <y( s >[~2~]) is a majority decision mixed state; its ith element is given 
by majority of the ith element values and 1 of the s memory patterns. ([•] stands for 
the Gauss symbol.) These mixed states can be made to automatically become equilibrium 
states by setting an appropriate threshold value, even when they are not learned. 

The threshold value, h, in Eq. (2) is calculated using the firing rate of the recalled 
pattern. The threshold value obtained by this method corresponds approximately to the 
optimum threshold value at which the storage capacity is maximized (Okada 1996). Since 
the firing rate of the equilibrium state is / when the memory pattern is recalled, the threshold 
value is determined by solving 

1 N ( N \ 

/= afE® E4>4 + *' ■ ( 9 ) 

JV i=l / 

When recalling the mixed state *y( s ' k \ f in Eq. (9) is replaced with firing rate /( s ' fc ) of the 
mixed state 7^'^: 

f(s,k) = E[7 (., fc)] 

= J2 s C n [fK n (l - K) s - n + (1 - f)R n (l - R) s - n ], (10) 

n=k 

where C is the number of combinations. 

The overlap between the equilibrium state x and the memory pattern rj^ is defined as 



If the equilibrium state x is exactly equal to rf v , = 1. The overlap between the 
equilibrium state x and the mixed state 7^' fc ) is defined in a similar manner: 

1 N 

M {s ' k) - - Vf^ s,fc) - f is ' k) )r- (12) 

M ~ N f( s ,k)(i- f{s,k))2-f l1 1 )X% - [LA) 

If the equilibrium state x is exactly equal to 7^' fc ), M^'^ = 1. 
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III. RESULTS 



A. Qualitative evaluation using lstep-S/N analysis 

Whether the mixed states become the equilibrium states of the model can easily be 
examined using the lstep-S/N analysis (Kimoto and Okada 2001). In this section, we 
examine the stability of the mixed state 'y (s ' fc ) using the lstep-S/N analysis. 

If an initial state x° of the model is set to a mixed state *y( s > k \ composed of the fist 
group memory patterns 77 1 ' 1 , 77 1 ' 2 , • • • , rj l,s , the internal potential U{ of the ith neuron can be 
described using Eqs. (8) and (11): 



Ui = 



s 

1," 



J2(m' U - fW" + h + zi, (13) 



N 



Nf(l - f) 



i=i 

aN s N 



Zi = 



1 ai\ s i\ 

Nf{1 _ f) EEUnr - fW - f)t k) - (is) 



At the limit iV — > 00, the overlaps become the same, to 1 ' 1 = m 1 ' 2 =,•••, = m 1,s , because the 
memory patterns, rj 1 ' 1 , r/ 1 ' 2 , • • • , rj 1 ' 8 , are at the same distance from the mixed state *y( s > k \ 
By placing these overlaps with m^ s ' k \ Ui becomes 



Ui = m 



{s > k) Y.^ U -f) + h + z l . (16) 



v=l 



The first term is a signal term to recall the mixed state *y( s > k \ The second term is the 
threshold value, and the third term is cross-talk noise, which prevents recall of the mixed 
state. At the limit iV — > 00, z,{ obeys the Gaussian distribution N(0, af^ s ' k ^s) because 
Vi") Vj V 1 an< l lj S ' k ^ in Eq. (15) are mutually independent. Here, /( s,fc ) is the firing rate of the 
mixed state; it is given by Eq. (10). Note that the first term in Eq. (16) is the linear sum 
of the memory patterns belonging to the first group. Therefore, the state of neuron 9(uj) 
can be made the mixed state 7^' fc ) when m^'^ > 0, h is set appropriately, and the variance 
of cross-talk noise is small sufficiently 

We next discuss the stability of the mixed states at the sparse limit, / — > 0. First, 
we evaluate the variance of cross-talk noise, af^^s. When the firing rate of the memory 
pattern becomes / — > 0, that of the mixed state becomes f^'^ — > and the variance of 
cross-talk noise becomes af( s ' k \s — * 0. Since crosstalk noise, which prevents recall of the 
mixed state, disappears at / — > 0, we need only evaluate m^'^ > to estimate the stability 
of the mixed state. Therefore, we next evaluate the value of m^'^. First, we rewrite m^'^ 
in Eq. (14) as a function of /, s, k, K, and R using Eqs. (3) and (4): 



m (s,k) 



/(I-/) 



i=k 
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s-l 



+ E s-iQfii-Ky-^K^ii-f) 

i=k-l 

+ j2 s _ 1 c i (i-f)(i-Ry- i R i (-f) 

i=k 

+ e .-iQa-^a-i?)- 1 -^ 1 ^-/)]. (17) 



i=k-l 



Next, we derive mS s,k > at / — > 0. By substituting i? = f\zj in Eq. (5) for Eq. (17) and 
setting / — > 0, the first term, the third term, and part of the fourth term can be omitted: 



s-l 

m (s,k) = s -iQ(l - ^) s - 1 -^ i+1 

i=fc-l 

+ E s-iQ(l-X)(0)*. (18) 



i=k-l 



The second term in Eq. (18) becomes 1 only at % — (k — 1) and becomes at i > 1 
(k > 2). The following equations are obtained by deriving m* 5 '^ separately for = 1 and 
k > 2. 



s-l 



fc = 1 ; m (s ' fc) = E »-iCi(l - K) s - l - l K i+1 + {l-K) = l (19) 

j=fc-i 

s-l 

k >2 : m (s ' fc) = E ^1^(1 - ^) s ~ 1 ^ i+1 (20) 



=fc-i 



We rewrite Eq. (20) as follows using the correlation coefficient between memory patterns, 
(a=(f^) 2 ^ 2 at/^0): 

k = 1 : m( s ' fc ) = 1, (21) 

s-l 

k>2:m {s ' k) = E - y/a) a ~ 1 ~ i Waf rl . (22) 

«=fc-i 

The k — 1 means the overlap for the OR mixed state, and the k > 2 means the overlap for 
the other mixed states. Therefore, m^'^ for the OR mixed state becomes 1 at / — > 0, and 
m ( s > k ) for the other mixed states depends on a . Let's consider the value of overlap m^'^ in 
Eq. (22). Though rrS s ^ = at a = 0, when a has a non-zero value, even a small one, m^'^ 
takes a non-zero value. When the memory patterns have nocorrelation (a = 0), the storage 
capacities of the mixed states, except for the OR mixed state, become because the signal 
term becomes at the sparse limit, / — > (Kimoto and Okada 2001). However, when the 
memory patterns are even slightly correlated (a > 0), the storage capacities for all mixed 
states may diverge because the signal term becomes non-zero at the sparse limit, / — > 0. 

We have discussed the qualitative mechanism of the stability of mixed states when the 
memory patterns are correlated. In the next section, we quantitatively analyze the storage 
capacities for each type of mixed state. 
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B. Quantitative evaluation using generalized SCSNA 



Here we quantitatively analyze the storage capacities of the mixed states using the gen- 
eralized SCSNA (Shiino and Fukai 1992, Toya et al. 2000). The order parameter equations 
of the equilibrium state derived using the SCSNA correspond to those of the equilibrium 
state derived using the replica theory of the statistical mechanics. 

We consider the case in which the equilibrium state x has non-zero overlaps, m 1,u = 
Nf(i-f) ^H=i{ r h' U ~ f) x ii with s memory patterns, r] 1,,/ (l < v < s). This means that the 
memory pattern belonging to the first group or the mixed state generated by the memory 
patterns of the first group is recalled. To derive the SCSNA order parameter equations 
of the present model, we first transform the synaptic coupling into the following form, 
which can easily be applied to the SCSNA. That is, Jij is divided into a term related to the 
memory patterns of the first group and another term. 

Jlj = Nf(l-f) ^} V *' V ~~ " f) 

i aN s 

~ ™ "- '> < 23 > 

We next introduce a set of i.i.d. patterns, of 1 ', to the (^f — /): 

EKH = 0, (24) 
E[afVr']=0, {y + v'\ (25) 

The second term of the synaptic coupling in Eq. (23) is rewritten using of" as 

1 s 

Jij = Nf(l-f) ~ f ) ^' U ~ f ) 

j aN s s 



■mi-f) 5S£^<- (26) 

where A vv > is the correlation coefficient between the memory patterns r]^ and rf^ of the 
same group. 

Let e v (v = 1, 2, • • • , s) be a set of normalized eigenvectors of the sxs dimensional matrix 
A composed of A vv >. We introduce a set of rotated patterns, erf = (of' 1 , of' 2 , • • • , cxf' s ): 

< = (27) 
T=(e 1 ,e 2 ,---,e s ). (28) 

Since the rotated patterns erf are simply rotated using the matrix T, the distribution is the 
same as that of erf. Using erf, we rewrite the synaptic coupling in Eq. (26) as 

Jld = Nf(l-f) ^ V '' U ~ ~ f ) 

j aN s 
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where X u is the eigenvalue of matrix A for normalized eigenvector e u : A 1 = 1 + (s — 
l)(-y£j) 2 CA 1 ' = 1 — (yEj ) 2 i (2 < v < s). Internal potential Ui is written as follows, using 
from Eq. (29) and the overlap m l,u from Eq. (11): 



Hi / J ijX j 



N 

£^ 

s aN s 

- f)m^ + £ £ X'dTrhr - asx u (30) 



where 



N 



r «^ (31) 

Using the SCSNA, we can easily derive the SCSNA order parameter equations. 

Yi = © (£ - Z)^ 1 '" + TF, + + tf) (32) 

i, „ _ IZo Dz < (vl ,u - f)Yj >rj , , 

f(l-f) (33) 

/oo 

D z < (Yi) 2 >T1 (34) 
-oo 



U = ^ D z z<Y l>ri (35) 

dz z 2 

D^-^eM-j) (36) 



* {\ V fU 



(37) 
(38) 



The < • • • ><q stands for an ensemble average over the first group memory patterns, 77 = 
(rjl' 1 , rjl' 2 , ■ ■ ■ , rj]' s ). Equation (32) may have more than one solution according to Maxwell's 
"equal area rule", which was originally applied to thermodynamics. According to this rule, 
Eq. (32) can be rewritten as 

Yi = B (£(^ - f)m^ + l -Y + V^z + h^j . (39) 

We can obtain the following SCSNA order parameter equations by integrating Eqs. (33)- 
(39). 

m " < 27(W) erf( )>r " 

1 < v < s (40) 
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, = i + i < erf( n=,(^-/K^ + f >fi (41) 

= "= < exp(-( l^%^±i )- >„ ,42) 

-oEtt^W (43) 



r = a 



s (\ U ) 2 U 



.4^ 1 - A"17 v ; 



We can then derive the relationship between to 1 '" and a by solving simultaneous equations 
(40)-(44). Note that the threshold value h must be determined first because some of the 
equations include h. The following order parameter equation, which determines the threshold 
value, is derived from Eq. (9). 



oo 



OO 



= i + i<-f(M^g^±i>, (45, 



To recall the mixed state -y( s > fe ), the threshold value is determined using the following order 
parameter equation, in which / in Eq. (45) is replaced with the firing rate, f^ s ' k \ of the 
mixed state. 

f^ = \ + \ < ^'^-^ + h ' + K n (46) 

The overlap between the equilibrium state x and the mixed state is derived from Eq. 
(12): 

"< 2/ M)(l- / M)) erf( V^= r } >TI ■ (47) 

Next, to investigate the effectiveness of the generalized SCSNA when applied to the 
present model, we compared the results of the SCSNA with those of a computer simulation. 
Figure 2 shows the overlaps to 1 ' 1 , to 1 ' 2 , and to 1,3 for various loading rates a when recalling 
the memory pattern r/ 1,1 . The data points and error bars show the results of the computer 
simulation, and the lines connecting the data points show the results of the SCSNA. We 
used /=0.1, a = 0.25, and s = 3. In the computer simulation, the number of neurons, N, 
was set to 10,000, and the simulation was run 11 times for each parameter. The data points 
show the median values, and the ends of the error bars show the 1/4 and 3/4 deviations. 
The results show that the overlap m 1,1 is nearly equal to 1 at a ~ 0, so the memory pattern 
77 1 ' 1 was recalled; to 1,2 and to 1,3 are 0.25, since the correlation coefficient between 77 1 ' 1 and 
rj 1 ' 2 ,r) 1 ' 3 is 0.25. The results of the SCSNA show that the overlap to 1,1 gradually decreases 
from 1 as the loading rate is increased from 0, and that the equilibrium state disappears at 
a ~ 0.078. The storage capacity is thus a c ~ 0.078. The results of the computer simulation 
correspond to those of the SCSNA for < a < 0.078; the equilibrium state became unstable 
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for a > 0.078. The results of the SCSNA and computer simulation also correspond well for 
the overlaps m 1,2 and m 1 ' 3 . 

Figure 3 shows the overlap M^ 3 ' 1 ) for various loading rates when recalling the OR mixed 
state 7( 3 ' 1 ). We again used / = 0.1, a — 0.25, and s = 3. The data points and error bars 
again show the results of the computer simulation, and the lines connecting the data points 
show the results of the SCSNA. The overlap M^ 3 ' 1 ) is nearly equal to 1 at a ~ 0, so the OR 
mixed state 

7 (3,1) is 

recalled. The equilibrium state disappears at a ~ 0.036, so the storage 
capacity is a c ~ 0.036. Since the results of the SCSNA are correspond fairly well with those 
of the computer simulation, as shown in Figs. 2 and 3, we used the SCSNA to examine the 
properties of the memory pattern and of the mixed states. 

Figure 4 shows the storage capacities of the memory pattern and of the mixed states 
for various values of a for s = 3 and /=0.01. Since a = is equivalent to a conventional 
model storing non-ultrametric memory patterns, the storage capacity is equal to that of the 
conventional model. At a = 0, the storage capacities of the memory pattern and of the OR 
mixed state are larger than those of the majority decision mixed state and the AND mixed 
state. As a increases, though, the storage capacities of the majority decision mixed state 
and the AND mixed state rapidly increase, more than the storage capacities of the memory 
pattern and the OR mixed state. 

To analyze the storage capacities of the memory pattern and the mixed states at the 
sparse limit, / — > 0, we plotted the asymptotes of the storage capacities for a = 0, 0.001, 
and 0.25 (Fig. 5). Since the present model corresponds to the conventional model at a = 0, 
the asymptotes of the memory pattern and of the OR mixed state diverge as l/|/log/| 
at the sparse limit, and those of the majority decision mixed state and of the AND mixed 
state approach 0, as we previously reported (Kimoto and Okada 2001). At a = 0.001 and 
a = 0.25, the asymptotes of the memory pattern and of all mixed states diverge as l/|/log/| 
at the sparse limit. Thus, when the memory patterns are even slightly correlated, the storage 
capacities for all of the mixed states diverge at the sparse limit. 

Figure 6 shows the threshold values h c for various values of a when the loading rate a 
reached the storage capacity a c . The threshold values were calculated using Eqs. (45) and 
(46) with / = 0.01 and s = 3. The figure shows that the mixed state, which becomes the 
equilibrium state of the model, can be changed by adjusting the threshold value. 

When the model of s = 3 becomes that of s = 4 due to the addition of a correlated 
memory pattern, how does the storage capacity of a mixed state composed of three memory 
patterns change? To answer this question, we examined the storage capacity of a mixed 
state composed of all four memory patterns belonging to the same group, that of a mixed 
state composed of three of the four memory patterns belonging to the same group, and 
that of a mixed state composed of two of the four memory patterns belonging to the same 
group, all in the s = 4 model. Figure 7 shows the results for OR mixed states. In the OR 
mixed state composed of all four memory patterns belonging to the same group, a c — > 4.2 at 
a — > 1. In the OR mixed state composed of only some of the memory patterns belonging to 
the same group, a c — > at a — > 1. The same properties were obtained for the other mixed 
states (results not shown). Thus, if a memory pattern is added to a group, the mixed state 
composed of all memory patterns, including the added memory pattern, becomes stable 
instead of the mixed state that had previously been stable. 
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IV. CONCLUSION 

We have examined a sparsely encoded associative memory model storing ultrametric 
memory patterns which have hierarchical correlation. We previously reported that storage 
capacities for most mixed states composed of uncorrelated memory patterns do not diverge 
at the sparse limit of the firing rate, / — > 0, in our paper (Kimoto and Okada 2001). On 
the contrary to the uncorrelated case, we have now found that the storage capacities for 
all mixed states composed of correlated memory patterns diverge as l/|/log/| even when 
the correlation of memory patterns is infinitestimal small. We have also found that as 
the correlation coefficient increases, the storage capacity of a mixed state composed of all 
memory patterns belonging to same group increases, while that of mixed states composed 
of only some of the memory patterns belonging to a same group decreases. Furthermore we 
have found that the mixed state, which becomes the equilibrium state of the model, can be 
changed by adjusting the threshold value. 
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